Interactive Sand Art Drawing Using RGB-D Sensor

We present an interactive sand art drawing system using one RGB-D sensor, such as Kinect. Our system supports the common sand drawing functions, such as sand erosion, sand spilling, and sand leaking. To use hands to draw virtual sand on a drawing plane, we design four key gestures which enable drawing manipulation actions for sand. The basic idea is that the gesture of one hand controls the drawing action. The motion and gesture of the other hand controls the drawing position. The process of our system has three major steps. Firstly, our system adopts a visionbased bare hand detection method which computes the hand position and recognizes the hand gestures. Secondly, the drawing position and the drawing action are sent to the sand drawing system. Finally, the sand drawing system performs the corresponding sand manipulation action. Experimental results show that our system enables sand drawing with bare hands and our system can produce a variety of pictures.